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ABSTRACT 

Four strategies used in judgment patterns were 
explored. 'Problem sets in which each solution strategy produces a 
unique solution pattern are depicted. Several experiments had been 
conducted using rules, in this way with subjects from grade 4 through 
college. Problems were set. in the context o£ concrete events which 
could be related, and subjects were as,ked about the relative 
likelihood of an outcome. A strong developmental trend was found, 
with students using increasingly sophisticated rules wi ^h increasinq 
age. Current efforts are focused on trying to account for trends, 
noting knowledge differences between age groups that may be 
implicated in the differences ^n rule use. An experiment to train 
seven-year olds to use th^ ta-versus-b rule is described; this was 
succei^sful. Next, students in grades .4, 5, 7, 8 were trained to use 
the sum-of "diagonals rule, again successfully. (mNS> 
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A variety of theorists have suggested that covariation judgment may ' 
be a key element in causal reasoning. That is, people may find likely 
causes of an event by searching for covaridtes of^ that^ event. If causal 
and covariation judgment ar^ interlinked in this way, then accuracy of 
covariation judgment may set ari upper limit to an individual's competence 
at causal reasoning. 

Evidence from our own investigations indicates that people show 
wide individual differences in competence at covariation judgment. In 
particular, a majority of adults employ rules whi^:h may lead to better 
than chance accuracy, but which result in systematic errors on same 
event relationships. We've focused our investigation on four strategies 
which might account for subjects' judgm*int: patterns. Each of theser 
strategies will be discussed in terms of the four cells of a 2 k 2 
contingency table, labeled cells ff,'b, c, and d in a left to right, top 
to bottom sequence. One conmonly proposed strategy is to judge 'a relationship 
according to the number of times the target event states co^occur, cell^ 
a of the contingency table. We term this strategy the Cell-a strategy. 
^ second approach might compare the number of times* the target event 
occurs with its supposed cause with the number of times that event 
occurs without that possible cause. This strategy would compare frequencies 
in contingency table cells a and b, a strategy we call a-^versus-b. h 
third strategy might compare the number of events confirming a relationship 
of target event and supposed cause with tht. number of events which would 
disconfirm ^uch a relationship. This strategy would compare the sum of 
frequencies in cells a and d with that qf cells b + c, a strategy we 
term sum of diagonals ((a + d) - b + c) ) . Finally, a mathematically 
sophisticated approach would cofnpare the probability of target event 

Children's Judgments about Cov^iriation between Events: 
A Serie*; of Training Studies. Appendix D. 



given tVie supposed cause with the probability of the event when that 
cause was absent. ^We call this strategy the conditional probability ^ 
strategy and is^ the only one of our strategies which will always produce 
correct judgments of event covariations. ^ 

Thus, we propose four different judgment rules varying in complexity 
and likely accuracy. Since different rules should produce different 
judgments, wc can construct a problem set where each solution strategy 
prpduces a unique solution pattern. A sample ot;^ such problems is illustrated 
in Table la. Problems are structured hierarchically such that cell-a 
problems are accurately judged by all rules; a-versus-^b problems should 
be correctly judged by all but cell-a judges. Sum-of --diagonals problems 
should be accurately judged by sum-of-diagonals and conditional-probability 
problems should be accusa^^ely judged by the conditional probability 
rule, alone. Accuracy of judgment is indexed by the direction of tha 
judged relationship, 7ox example, a-versus-b judges should judge the 
conditional probability problem in Table la as a case in which A2:is 
less likely given Bj, than given P2 (2-12). Sum of diagonals judges 
should judge the two events as unrelated (2 + 10 ^ 0 + 12). and conditional 
probability judges should see Aj^ as more likely given Bj than given B2 ^ 
(2/2 vs. 12/22), A subjects' strategy is Indexed by the accuracy pattern 
on a 12 problem set," including 3 problems of each of the problem strategy 
type. Table lb indictees judgment accuracyx predicted by each of the 
proposed rules. Subjects who pass no problem t^pe^s are labeled Strategy 
0. All other patterns not represented in the table would be labeled 
unclassifiable. We've looked at rule use in this way in several e^^periments 
involving subjects from 4th grade through college age. Problems in 
these experiments ars set in the context of concrete events vhich could 



4 

J 



X 



be related. Frequency information is represented in pictorial format in 

t 

a 2 X ? table-. Subjects are asked about the relative likelihood of an 
outcome given the two alternative states of the other variables. 

Our past evidence ^dic^tes a strong developmental trend in the 4th 
grade to college age span. The modal strategy at 4th grade w^s the a- 
versus-b rule, although Strategy 0 and unclassifiable judgss were also 
common. The sum of diagonals rule was used by a substantial group of 
subjects in our 7th and 10tij^^g;?d«/e samples. The conditional prcfbability 
rule was used by a substantial minority of subjects irt tenth grade and 
college. The cell^a rule was rare at all ages tested. Thus, subjects J 
used increasingly sophisticates! rules with increasing age. Hc^ever, the 
optimal conditional probability rule was used by a minority of subjects ^ 
even at college age, 

Having discovered these developmental trends, our current efforts 
are trying to account for those trends. That is, what knowledge differences 
between these age groups may be implicated in the differences in rule 
use. A common approach to the problem is to develop a training method 
which is effective'in eliciting use^ of more advanced rules. Contents of 
those effective interventions allow us to identify one sufficient account 
of naturally occurring developmental trends. Effective training prograias 
may also be of pragmatic value in improving covariation judgment, 

Our^first concern was with, the many fourth graders who didn't match 
any of our proposed rules. Given the number of such subjects, we have 
to consider the possibility that these children were confused by some 
aspect of our method and vere unable to demonstrate their true competencies. 
Our approach was elaborate our instructions to insure that the children 
understood the tabled stimuli and to reformulate the covariation question 
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in a syntax more appropriate for younger children. / 

These modifications were made to make our problems more comprehensible 
to younger children^ It turns out that we outdid ourselves in this 
respect. Testing a new sample of children, nearly all of ourtSubje^its 
were classifiable by one of $ur rules in the f^rth grade, and a majority 
of children showed systematic rule use in the second and third grades. 
Overwhelmingly, these subjects were classified -las using the a^ersus-b 
rule. Unclassrlf iable and Strategy 0 judgment patterns wei:e predominant 
amons_^l?rst and second grade children. As a result, ^this population wa^ 
'he target age for an attempt to elicit use of a simple judgment rule. 
Thus, the first exp^H^nt I'll describe is an attempt to train- 7 yftar 
old subjects, to use the a^versus^b rule. We opted not to train children 
in use of the cell-a rule since it so uarely occurred naturally. 

4 

Our training approach stemmed from our suspicion that the judgment 
question itself focused children's attention on cells a and b of the 
contingency table. Asked if<^lants are more likely to be healthy when 
they get bug spray or when they don't get bug spray, a subject may look 
at those two event conjunctions (i.e. healthy plants-bug spray; healthy 
plants-no bug spray). We thought of this as .a problem of attention 
direction. This was the reasoning behind our^ attention only condition, 
where, on a set of 6. training problems, the experimenter asked the 
subject tc point' to the event combinations specifically mentioned in the 
question end to count the number of cases in each of the two cells. 
Subjects then made their covariation judgment. Subjects had mastered 
this technique fay Che end of the training^jroblems. 

A subject may also lall use the a-'^'ersus-b rule because he or 
she misses the comparison aspect of che question i.e.^ which Is more 
likely. A second group of subjects were given the Attention instructions 



on the training problems and, in addition, flfere specifically asked which 

ot the two cells had more cases in it. Subjects then made their covariation 

judgments. Subjects also mastered this technique by the end of "the 

ning problems . This group is the Attention-plus-Mor e training group. 
A final group is a no training control group, who judged the same 6 
problems but were given no special instruotioHiS. 

AM subjects were pretexted to es^tablish initial ruls use. Unclassif iable, 
Strategy 0 and cell-^a judges were included in the paradigm. Subjects 
. were randomly assigned to one of the three conditions. 

Subject fatigue prevented an immediate posttest of training effects. 
However*" all subjectb did tetum a week later for a delayed posttest. 
Subject*3 performance at that time is illustrated in Table 2 of your 
handout. As you can see, rates of improvement were at the same low level 
for At tent ion "Only and control subjects. This failure of Attention^only 
instructions may imply that subjects at this age already know how to 
find the relevant c^lls. However, the Attention-plus-Mcre training did 
result in reliable imprcvemeiit at the delayed posttest. Thus* we see 
that the comparative aspect of the judgment may be a key obstacle to 
natural use of this simple rule by young 'subjects. ^ 

Having discovered that young children could use this simple rule, 
we next attempted^to elicit uSe of more advanced rules from oldeV subjects. 
Our first approach was to traiit-siifijects to use the yum-'of-diagcndls 
^^^t^gy. This strategy is built on the notion that some event combinations 
qonfirm a particular relationship between events and that soirte combinations 
disconfim that rule. For example, if bug spray is good for plants, we ' 
should see/many cases of healthy plants with bug spray and unhealthy 
plants without bug spray. Heathy plants without bug spray and unhealthy 
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plantis with bug spray would be exceptions to the relationship. Sum-of- 
diagonal^ training taught subjects that cells a + -d were good examples 
of a ft§sitive relationship and that cells b + c were e^cceptions to the 
rule,. Subjects |eamed that the reverse was trVe for negative relationships 
Subjects practiced pointing to the cells Hith good examples and those 
with exceptions to the rule on each of 6 training problems. Subjects 
also counted the number ot cases in cells a -f b and in cells b + c for 
the training problems. These subjects then made their' cu/ariation 
judgments.' A group of control- subjects made covariation judgments on 
the same problems without the benefit of training. Training effects 
were measured in an immediate posttest and in' a delayed test one week 
later. Subjects in the experiment were 4th, 5fch, 7th aad grade ■ 



children whose pretest performance showed use of cell-^a and a"versus**b 

V 
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rules. t ♦ , 

'TJhe results of this training ejtperlment are shoim in Table 3. Note 

' ■ ■ / 

that unclassif iable posttes^t subjects were not included in the analyses. 

Trained subjects were significantly more likely to show use of the sum* 

of-dlagonals rule both at the itmnediate and at the delayed ^posttest. 

This evidence indlcat^js that subjects can indeed show improved rule use 

with a relatively simple training procedure. These training probedures 

were similarly effective among the younger and older subjects in the 

sample. Our training in confirming and disconf inning cases not only 

yielded better accuracy, but those judgments also conformed to the 

+ 

pattern predicted by the sum^-of-^diagonals rule. This suggests that this 
reasoning may well underly the natural acquisition of this rule in 
children's development. At a minimum, these training effects identify 
one sufficient model of this developmental process » 
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Our final efforts at training are looking at what it takes to 
elicit use of the optimal conditio^l probability rule among junior high 
aged subjects. Thus far it looks like our training efforts are successful. 

C 1 

This set of training studies suggests that subjects at all agea may show 
problems in covaria^'tion judgment but that those proMems are not irremediable. 
Our evidence suggests that relatively simple training efforts can*elicit 
use of more sophisticated and more accurate judgment rules. 
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Table 2 

Effects of a-versus-b Training on Delayed Posttest 
performance of 7 year old children 

Didn't 

*Imp roved Improve Total 

Control 3 9 ' 12' 



Attention 3 . - 9 12 

Only ^ ^ X ^ 



= U.02, df ^ 2, p < .01. 



Attention 10 2 • 12 

^)lus more ^ 



Total ' 10 20 , 36 




control 

Training 

Total 



Table 3 

t Effects of Sum-of-Diagonalls Train^^ng 
on Immediate and Delayed Posttest 
pGrfortnance on Ath-8th grade children 

Immediate Posttest 



Improved 

) 

A 

15 
19 



Didn' t 
Improve 

17 . 

6 

' 23 



Unclassif iable 
2 
8 
10 



Delayed Posttest 



Improved 
5 ■ 
21 
26 



Didn't 
Improve 

,1A 

6 

20 



Unclassif iable 
A 
2 
6 



N * 
23 
29 ^ 
52 



= 9.6, df- » 1» p <^ .01 



9,87, df = 1, P < .01 
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